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We attempt image restoration in the framework of the Bayesian inference. Recently, it has been 
shown that under a certain criterion the MAP (Maximum A Posterior) estimate, which corresponds 
to the minimization of energy, can be outperformed by the MPM (Maximizer of the Posterior 
Marginals) estimate, which is equivalent to a finite-temperature decoding method. Since a lot 
of computational time is needed for the MPM estimate to calculate the thermal averages, the 
mean field method, which is a deterministic algorithm, is often utilized to avoid this difficulty. 
We present a statistical-mechanical analysis of naive mean field approximation in the framework 
of image restoration. We compare our theoretical results with those of computer simulation, and 
investigate the potential of naive mean field approximation. 
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I. INTRODUCTION 

In this paper, we investigate the image restoration 
problem. This problem involves synthesis of an image 
from a corrupted image with a model of the informa- 
tion available (or assumed) on the source image and the 
corruption process 01 Hi @- The problem lends itself 
naturally to a Bayesian formulation, which estimates a 
probability (posterior) for the original image on the ba- 
sis of the model probability (priors) of the assumed model 
of the source image and corruption process. 

One strategy in image restoration is to use the 
Bayesian inference by adopting the image that maxi- 
mizes the posterior probability. This method is called 
the maximum a posteriori (posterior) probability (MAP) 
inference. Given a corrupted input image, the MAP in- 
ference accepts the image that maximizes the posterior 
probability as the restored result. The logarithm of pos- 
terior probability can be regarded as the energy, so we 
can consider the MAP inference as an energy minimiza- 
tion problem. Therefore, the image restoration problem 
can be regarded as an optimization problem. Geman & 
Geman demonstrated that the MAP inference result can 
be applied to the image restoration problem by using sim- 
ulated annealing, which is a tool for searching the ground 
state ^. 

Another strategy is the inference in which the expecta- 
tion value with respect to the maximized marginal pos- 
terior probability at each site in thermal equilibrium is 
regarded as the original image. This method is called 
maximizer of the posterior marginals (MPM) inference 
[H Hi- MAP inference, the posterior probability 

is given for each set of pixels. In contrast, in the MPM in- 
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ference, the posterior marginal probability controlled by 
the temperature T is given for each pixel value. To find a 
restoration image by the MPM inference, we should cal- 
culate thermal average for each pixel value. The MPM 
inference includes the MAP inference 1^ because , at 
the limit of the temperature T ^ 0, the MPM inference 
becomes equivalent to the MAP inference. In general, 
however, the MPM inference is evaluated at T > 0, so 
this method is also called "finite temperature restora- 
tion" , and the MPM inference has an advantage over the 
MAP inference in the restoration ability of each pixel 0| 

i- 

Recently, the MPM inference has been discussed in 
the field of error correcting code [§) |6) . The problem 
of error correcting code is similar to the image restora- 
tion problem in the sense that the received bit sequence, 
which corresponds to the image represented by a set of 
pixels, is corrupted by noise, and the receiver tries to 
retrieve the original bit sequence/image from the noisy 
one. The major difference between error correcting code 
and image restoration is that the image restoration prob- 
lem usually gives only the corrupted image and not other 
additional redundant information. Therefore, in image 
restoration, we usually assume alternative information 
for the original image such as the prior probability. In 
the field of error correcting code, Rujan has pointed 
out that carrying out the decoding procedure not at the 
ground state but at a finite temperature is effective 
Sourlas used the Bayes formula to re-derive the finite- 
temperature decoding of Rujan's result under more gen- 
eral conditions 

Assuming the number of pixels as TV and each pixel as 
a binary unit that can take {—1, +1}, the number of fea- 
sible combinations of pixel values becomes 2^. Because 
of the existence of local minima, finding the ground state 
task is very difficult with a method such as the gradient 
decent. Thus, to apply the MAP or MPM inference, we 
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FIG. 1; Schematic diagram of image restoration problem 



usually use a relaxation method as typified by anneal- 
ing technique. Moreover, the MPM inference involves 
a more important problem as described below. In the 
MAP inference, once the system reaches the macroscopic 
equilibrium state, each pixel value can be properly deter- 
mined with its probability as 1. On the other hand, in 
the MPM inference, when the system reaches the macro- 
scopic equilibrium state, each pixel value cannot be deter- 
mined uniquely because the probabilities of each binary 
state have some finite values in the finite temperature de- 
coding. Therefore, we should calculate thermal averages 
for each pixel, and this requires many samplings. 

In this study, we discuss an approximation that re- 
places the stochastic dynamics of the MPM inference 
with deterministic dynamics. In statistical mechanics, 
this approximation is called the "naive mean field equa- 
tion (NMFE)" §. The NMFE has usually been apphed 
for emulating the behavior of the stochastic unit. By Ap- 
plying the NMFE, each restoring unit, which is defined 
as a stochastic binary unit, is replaced by a deterministic 
analog unit that takes [—1,-1-1]. One important advan- 
tage of applying NMFE is the ability to reduce calcula- 
tion cost by eliminating the need to calculate thermal av- 
erage , which requires many samplings. The NMFE has 
been applied to several combinatorial optimization prob- 
lems such as the traveling salesman problem (TSP) [0. 
However, almost all researchers who have used NMFE 
have not pursued quantitative issues such as the accu- 
racy of the approximation. 

In §1^, we formulate the image restoration problem us- 
ing the Bayes inference in the manner of Nishimori & 
Wong's formulation 0. Recently, from the statistical- 
mechanical point of view, Nishimori & Wong have for- 
mulated the image restoration problem by introducing 
a mean field model for binary image restoration. They 
analyzed the model theoretically by the replica method. 
We applied NMFE to the formulation and analyzed it by 
the replica method in the manner of Bray et al. ^ . 

In §[II, we compare the results between our analysis 



and computer simulations. Within the limits of the mean 
field approximation, our analysis showed agreement with 
the computer simulations. However, the prior probabil- 
ity derived from the mean field approximation, which is 



called an infinite range model, is usually not practical for 
a real image prior. Therefore, we discuss the difference 
between infinite range model and its origin, called the 
nearest interaction model. 



II. MODEL AND ANALYSIS 

A. Formulation of the Image restoration 

In this section, we apply the mean field theory to the 
image restoration problem in the manner of Nishimori 
& Wong. Figure [| shows a schematic diagram of im- 
age restoration. The original image is represented by 
{^i}, and each unit is a binary unit that takes two states 
{—1,-1-1}. The number of units corresponding to the im- 
age size is denoted by N . In addition, the original image 
{^i} is assumed to have the following prior probabilities: 

^.(UO) = ^exp(|^^,C,), (1) 



Z(/3,) = Tr5exp(§^e.e. 



(2) 



where f3s > 0. The operator Tr^ means trace, a sum over 
all possible 2^ states of Z{f3s) indicates the partition 
function of this prior probability. Assuming Ps > 0, this 
probability suggests that pixel values £_i and have a 
tendency to take the same value. 

In image restoration, the interaction between each 
pixel should be described by a local rule, such as a sum of 
the nearest neighbors. For analysis by the mean field the- 
ory, however, we replace this local interaction rule with a 
global one, that means each pixel has interactions to all 
other pixels. 

In the conventional image restoration framework, the 
transmitting signal is only the raw code ^ (upper path 
in Fig.^. However, considering the similarity of the 
formulation of the error-correcting code problem using 
a Bayesian inference |^ 0, it is natural to intro- 
duce transmission of a redundant code for better im- 
age restoration. Nishimori & Wong proposed the in- 



troduction of a redundant code called the "parity check 
code" (lower path in Fig. [|) as well as the raw code. 
For comparison with their results, in this study we also 
adopted transmission of the parity check code. For 
the parity check code, we adopted a 2-body interac- 
tion term denoted by S.i^j/N. The reason for divid- 
ing ^i^j by N is to apply the mean field theory. At 
the receiver side, the transmitting signal corresponds 
to Ti, and the parity check code ^i^j/N corresponds to 
Jij. The posterior probability based on observation sig- 
nal Pi{£,i}\{Jij},{Ti}) can be represented by the Bayes 
formula: 
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FIG. 2; Analog neuron decoder for analysis; In Ising model, 
encoding unit corresponds to decoding unit ai. On the 
contrary, the analog model assumes decoding unit have M 
units, and their average is regarded as the analog unit output. 



Pi{^^}\{J^,}Ar^}) « Pout ({ J., } , {t.} | {^DP. ({6}) • 



(3) 



When the receiver can guess the form of the original 
image posterior probability, the restoring posterior prob- 
ability can be assumed by replacing the original pixel 
value with the estimated pixel value ai. In general, 
however, the receiver could not guess the original im- 
age prior probability accurately. In order to evaluate 
the performance of the restoration ability by the differ- 
ence between the original image prior and the restoring 
prior, we assume that the restoring image prior probabil- 
ity Pm{') has a different parameter /3„j from the original 
image prior Ps{-)- 

Pm {{(Ti}) = ^^^^^ 51 '^^'^j)' ('^) 



TiV exp(^^cr,CTj), 



N 



(5) 



i<j 



where Pm > 0. Each form of prior is identical mathemat- 
ically except for the parameters of interaction strength. 
We primarily discuss the Ps ^ Pm case. 

Po\it{{Jij}, {Ti}\{£,i}) is a conditional probability of the 
observation signal, and it is a probability expression of 
the corrupting process in the transmission channel. In 
this study, we assume that the noise added in the cor- 
rupting process is similar to Gauss distribution as fol- 
lows: 



Pout({J,,},{Tj|U.})(X 
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(6) 



The first term in the exponential indicates that the noise 
corresponds to the parity check code, and the second 
term corresponds to the raw code. For the first term 
in the exponential, the random variables Jij follow the 
normal distribution, whose average is Jo£,i£,j /N , and the 
variance is J"^ /N . In the second term in the exponential, 
the random variables Ti follow the normal distribution 
whose average is To^i, and the variance is r^. 

Nishimori & Wong discussed the macroscopic charac- 
teristic of this system by using statistical mechanics . 



They introduced a system that has the following Hamil- 
tonian: 



H = -P^J.jU.aj - -^^<T,aj - h'^na^. (7) 

i<3 i<3 i 



They calculated the free energy by the replica 
method for averaging probabilities Pg ({^i}) ^'^d 
Pout({Jy},{Tj}|{^i}). Ignoring the 2-body interaction 
term, that is /3 = 0, this Hamiltonian consists of the prior 
probability term and the observed data fitting term. This 
form is equivalent to the conventional cost function form. 

In the MAP inference, the estimation value of restored 
pixels a results in the minimum of the Hamiltonian de- 
fined in eq. (|^). On the other hand, the MPM inference, 
which corresponds to the finite temperature estimation, 
estimates pixel values by the sgn((CTi)), where (ci) means 
the thermal average. Considering the limit of the tem- 
perature at 0, the MPM inference becomes equivalent to 
the MAP inference. 

We introduced the quantity overlap Mo to evaluate the 
restoration ability measure for the MPM inference. 



(8) 



Nishimori & Wong suggested that the minimization of 
the Hamiltonian and the maximization of the overlap 
are not equivalent . Moreover they also indicated that 
the MPM inference (finite temperature estimation) has 
better restoration ability than the MAP inference in the 
sense of the overlap: 



Mo = Tre,j,,P, ({CJ) Poni{{J^,}, {Ti\m}) 
X ^,sgn((CT,)). 



(9) 



This overlap can be evaluated by averaging probability 
variables with the statistical-mechanical technique. 



B. Naive mean field approximation 

In the finite temperature decoding which corresponds 
to the MPM inference, we should calculate the thermal 
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average (ci), which means the estimation value of ct;. 
We evaluated the calculation cost of MPM inference by 
computer simulation. As we will show that calculating 
this average requires about 50 times longer computa- 
tional time than that for achieving to the macroscopic 



equilibrium state. This result will be given in §111 



In this study, to find the ground state, we introduce 
the analog neural network model for approximation pro- 
posed by Hopfield & Tank jl^]. By this approximation, 
each Ising unit is replaced by an analog unit that can 
take continuous value [—1,-1-1], and the output of each 
analog unit can be regarded as the thermal average of 
the corresponding Ising spin unit, which can take two 
states <7i = ±1. For replacing Ising unit to analog one, 
we introduced a Hamiltonian as substitution for eq. (|^) 



-(3 J^Jhsj - %^ X! ^'^3 -h'^n. 



i<j 



N 



i<j 



(10) 



where the unit Si is an analog unit. M is a scaling factor 
described as below. Following the manner of Bray et 
al^, we assumed each ith site consists of M Ising units, 
and the analog unit output Si is calculated by the average 
of M Ising units dia (see Fig. ||). 



1 " . 



(11) 



Considering the limit Af — > oo, each output Si can take 
an analog value [— When M is a finite value, the 
analog unit output Si is called 'binominal spins' which 
can take — 1,— l+j^,-- - ,1— ^^•,1 with binominal dis- 
tribution. So that, we can define 'spin weight function' 
as 
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dui exp{M ("UiSi -|- In 2 cosh(ui))). 



(12) 



The partition function Z can be described as 

N r+i 



n 



M 



ds,W{s,)exp{n) 



N 



i=i 



exp(M(/3^ JySiSj -I- + fey^r^a 



N 

UiSi -I- In 2 cosh(ui))) 



(13) 



In the limit Af ^ oo, the integrals over {ui} and {si} in 
eq. (p^ could be evaluated by the saddle-point method. 



The stationary equations are 



= /3^ Jy S, 



= — Si + tanhuj 



An 

N 



Y^SiSj + h^^TiSi - Ui, (14) 



Eliminating u^, we can obtain 



Si — tanh(/3 ^ JijSj + ^ ^ sj + hr, 



N 



(15) 



(16) 



From the manner of Hopfield & Tank , we can also 
consider a discrete synchronous updating rule: 



tanh(/3 > J, 



TV ^ ^ 



(17) 



where s* denotes the analog unit output at time t. When 
the system described by eq. (^^ reached to the equi- 
librium state sf°, whole units should satisfy eq. (|lq). 
Therefore, to investigate the equilibrium state of dynam- 
ics (|l7|), we should take the analog Hamiltonian described 
by eq. (|l^) correctly. In the equilibrium state, each ana- 
log unit state expressed by sf° corresponds to {ai), i.e. 
s°° can be regarded as the thermal average of cr^ . 

This analog unit replacement is sometimes called the 
"naive mean field equation (NMFE) approximation" . 
From eq. (p7|), this system follows deterministic dynam- 
ics, so that it is no need to calculate the thermal average 
of stochastic unit; therefore, the calculation cost is lower 
than the stochastic Ising model. 

However this replacement from stochastic Ising unit 
(7; to the deterministic analog unit Si is an merely sub- 
stitution. Thus, we should analytically investigate the 
result of applying NMFE by analog model to compare it 
with the estimated thermal average of the Ising model. 
Hence, to investigate the equilibrium state of the system 
described by eq. (^6|) , we should analyze the system that 
has the Hamiltonian described by eq. (p^). 



1. Replica method 

We now analyze the system that has the Hamiltonian 
described by eq. (|o|) by the "replica method", which 
is a standard statistical analysis tool. The n replicated 
partition function can be expressed as: 



[Z"] = Tr 



l[dJ, 



N 
27rJ2 



n 



dr, 



xPs(ua)Pout({j,,},{Tai{e.}) 



(18) 



+ 



MN 



i<j.a,a,b 
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where operator Tr means the sum over ah states about 
{(Tj" } and {^i}- We analyzed this rephcated partition 
function by the standard rephca method. The repHca 
symmetry solution can be described as: 



tuq = tanh(/?sr7io), 

_ Tr^ e'''™o« / Dx F{U{x)) 
2cosh(/3smo) 
^ _ Tr^ e'^^'"''^^ / Dx F{U{x)) 
2cosh(/3smo) ' 
_ Tr^ e'^^™"? / Dx F{U{x)f 



X = 



2 cosh(/3smo) 

1 Tr^ e'^.^oC J jj^ xF{U{x)) 

~^/WW+W^ 2cosh(/3,mo) 



(19) 
(20) 

(21) 

(22) 

(23) 



where U{-) means 



U{x) ^ y/h^T^ + l3^J^qx + Pram + (/itq + /3 Joi)^, 

(24) 

and the function F{-) is a solution of the self consistent 
equation: 

F{x) = taiih{U{x) + P^J^xF{x)). (25) 
Using these solutions, we could obtain the overlap Mo'- 

Mo = -^^C»sgn(sO 

i 

_ Tr^ e'3="«« / Dx ^sgn{U{x)) 
2cosh(/3sTOo) 



(26) 



III. RESULTS 

In this section, we compare the analysis results be- 
tween applying the NMFE approximation (analog model) 
and estimated thermal average of the Ising model. We 
also compare these theoretical analyses with the com- 
puter simulation results. 

In the following subsection from III A to III Cj , we 
treated infinite range Ising/analog model. In the infi- 
nite range model, the original image prior probability is 
defined by eq. (|l|), and the image is corrupted by the 
noisy channel according to eq. (^). In the infinite range 
Ising model, we assumed restoring prior probability as 
eq. (^, and the Hamiltonian could be derived as eq. (|^). 
On the other hand, in the infinite range analog model, 
we defined the Hamiltonian as eq. (|lO|). 

However, for image prior, the infinite range interaction 
is just a little strange assumption. Thus, we introduced 
models whose prior have only nearest neighbor interac- 
tion in pi D . We call them as Ising model with near- 
est neighbor interactions and analog model with nearest 
neighbor interactions respectively. Unfortunately, it is 
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FIG. 3: Infinite range Ising model Restoration Ability with- 
out parity check: In decoding, when the proper temperature 
(Tm = 0.9) is chosen, restoration ability indicates better than 
that of the temperature limit (T™ — > 0). When decoding tem- 
perature Tm equals to encoding temperature Ts = (/37^)i 
which is appeared in the eq. (hi), the decoding ability be- 
comes large. In the Monte Carlo simulation, we use the infi- 
nite range Ising model, which is described by eq. (^), as the 
decoding prior. 
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FIG. 4: Infinite range analog model Restoration Ability with- 
out parity check: Formally, the analysis result becomes iden- 
tical to the infinite range Ising model analysis result. In the 
simulation, we use the eq. ( p^ as the discrete synchronous 
dynamics. 



difhcult to treat the nearest neighbor interaction mod- 
els analytically. Therefore, we calculated the result of 
nearest neighbor interaction models by computer simu- 
lation and compared them with the result of the infinite 
range models. In the nearest neighbor interaction mod- 
els, we assume that the corruption process in transmit- 
ting is same as infinite range model, that is defined by 
eq. (§. 

In the Ising model Monte Carlo simulation, we use the 
asynchronous Glauber dynamics, i.e. we selected one site 
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ai randomly, and calculate probability as 
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(1 ± tanh(/3 J^^i + ^ + /^^O) 

P(cr, = ±1) = . 



According to the probability the selected site ai is de- 
cided. 

On the other hand, for analog simulation, we used dis- 
crete synchronous update rule described as eq. (p"^). i.e. 
whole units are updated simultaneously. We consider 
each unit value in the equilibrium state as its thermal 
average. 



A. Without parity check code 

First, we discuss the case where no parity check code is 
used (/3 = 0). This case corresponds to the conventional 
image restoration problem. In the analysis, when /3 = 0, 
the order parameter equations obtained in the previous 
section are identical to the result of the Ising analysis 
suggested by Nishimori & Wong 0. Thus, the MPM in- 
ference by the stochastic infinite range Ising model and 
deterministic infinite range analog model are equivalent. 
Figure || illustrates the restoring ability of finite temper- 
ature decoding using the infinite range Ising stochastic 
units. Figure ^ shows the restoring ability using infi- 
nite range analog model. In each figure, the vertical axis 
means the overlap Mq, and the horizontal axis means 
the restoring temperature Tm, which is corresponds to 
the restoring image prior coefficients Pm {Tm = Pni')- 
The solid line means the analysis result by the replica 
method, and each error bar shows the quartile deviation 
obtained by the computer simulation. 

We set the parameter T,, which is the reciprocal of 
the original image prior coefhcients j3s {Tg = fij^), at 
Ts = 0.9. At the Umit of T„ 0, the MPM inference 
becomes equivalent to the MAP inference. In both figures 
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FIG. 6: Analysis comparison between infinite range analog 
model and infinite range Ising model using parity check code 
(/3 > 0) with small noise variance (J = 0.6). For decoding, we 
assumed infinite range model that is described as eq. (Ml). In 
this figure, the encoding and decoding temperatures is fixed 
as Ts^Tm^ 0.9. 
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FIG. 7: Analysis comparison between infinite range analog 
model and infinite range Ising model using parity check code 
(/3 > 0) with large noise variance (J = 1.0). For decoding, we 
assumed infinite range model that is described as eq. (M). In 
this figure, the encoding and decoding temperatures is fixed 
as Ts^Tm^ 0.9. 



§and^, the restoration ability around Tm = {Ts) — 0.9 is 
better than that of T„ 0. This means that the MPM 
inference has better image restoration ability rather than 
the MAP inference as far as the overlap. 



B. Convergence speed 

The biggest advantage of the analog model over the 
Ising model is its lower calculation cost. In this section, 
we discuss the calculation time that should be set in the 
computer simulation for each method. 

We observed the convergence time of the overlap in 
each simulation. Figure ^ shows the convergence speed. 
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FIG. 8: Comparison between simulation result with infinite 
range Ising model restoration ability. The parity check code 
is used and its noise level is defined as J = 1.0. 
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nite range analog model restoration ability. The parity check 
code is also used and its noise level is defined as J = 1.0. 



In the infinite range Ising model, we adopt the syn- 
chronous update and define Nra updates as one Monte- 
Carlo step (1 MCS). Nra means the number of units in the 
simulation. A synchronous analog update corresponds to 
1 MCS in the sense of the number of update units. The 
horizontal axis of Fig. ^ indicates the calculation time 
measured by MCS. The vertical axis means the average 
of overlap at that time. Each model achieved the macro- 
scopic equilibrium state in 20 MCS. The analog model 
adopts a deterministic algorithm, we can calculate sf at 
that time, and the Mo converges at 20 MCS. However, 
assuming an Ising stochastic algorithm, we should cal- 
culate the thermal average of Si by sampling. Figure ^ 
shows that needs about 1000 MCS to converge. In this 
result, the deterministic infinite range analog model con- 
verged 50 times faster than the stochastic infinite range 
Ising model in finite temperature decoding. 



C. Using parity check code 

In the replica method analysis, the infinite range ana- 
log model and the infinite range Ising model are equiv- 
alent in the case using /3 = 0. This is derived from the 
fact that the susceptibility x remained at under /? = 0. 
Using the parity check code for better restoration, the 
analysis results differ. In the case of /3 > 0, x becomes 
greater than 0, and the term corresponding to x iii eq. 
( psi ) is effective. This term is called the Onsager reaction 
term in statistical mechanics. As a result, a difference in 
analysis between the Ising model and the infinite range 
analog model appears. 

When the noise variance of the parity check code is 
small (e.g., J '-^ 0.6), the infinite range analog model and 
the infinite range Ising model are almost the same in the 
sense of overlap. In this case, little noise exists in the 
parity check code, and better image restoration is possi- 
ble. Figure H shows a comparison of overlaps obtained by 
each replica analysis. The horizontal axis indicates the 
parameter /3, and the vertical axis indicates the overlap 
Mo- We assumed that the decoding temperature is opti- 
mal {Tm — Ts{— 0.9)) and that the parameter is /i = 1. 
Comparing /3 with /i, /3 becomes large, the restoring sys- 
tem tends to rely on the parity check rather than the raw 
code. Each restoration result appears the same, and bet- 
ter restoration is achieved than in the case transmitting 
the raw code only. 

Figure ^ shows the case of large noise variance in the 
parity check code channel (J = 1.0). The horizontal axis 
signifies /3. In this case, each method restores better than 
when only the raw code channel is used. However, relying 
on P too much results in poorer restoration result than 
when only the raw code channel is used. A difference 
between the infinite range analog model and the infinite 
range Ising model appears as restoration worsens. When 
the noise variance of the parity check code becomes large, 
the restoration ability of infinite range analog model is 
not as good as that of the infinite range Ising model. 

Figure ^ shows the computer simulation result of the 
infinite range Ising model under the noise variance pa- 
rameter J = 1.0, and Fig. ^ shows the computer sim- 
ulation result of the infinite range analog model. Each 
simulation matches the analysis curve, and the perfor- 
mance of infinite range analog model simulation is not 
much better than that of the infinite range Ising simu- 
lation. However, when we properly set the ratio of the 
coefficients (3, (3m, and h, the performance of each is opti- 
mized and the peak of ability for each is almost the same. 
Thus when we can estimate the hyper-parameters prop- 
erly, there is no difference between these two methods. 



D. Ising/analog model with nearest neighbor 
interaction 



In each infinite range model we compared, we assumed 
that all units have interactions with each other in prior 
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FIG. 10: Simulation result of Ising/analog model with nearest 
neighbor interactions. The vertical axis indicates overlap Mo, 
and horizontal axis means decoding temperature Tm = l/Pm- 



probabilities to use the mean field approximation. How- 
ever, it is more natural that these probabilities are de- 
fined by their nearest-neighbor interactions. We call the 
model whose encoding/decoding prior probability is de- 
fined by the nearest neighbor interaction on the pixel 
lattice the Ising/analog model with nearest neighbor in- 
teraction. It is difficult to analyze the nearest neigh- 
bor interaction model with a statistical tool because of 
its local interactions. Nishimori & Wong compared the 
analysis result of the Ising model with nearest neighbor 
interaction solved by computer simulation . Figure 
shows the results of our reproduction. The image size is 
400 X 400 pixels, and the original image's prior probabil- 
ity is denoted: 

Psim) = ^exp(/3.5]e.O), (27) 
ZiPs) = Tr^exp(/3,^e.ej), (28) 

where the summation ^^^^^ denotes a sum extending over 
all pairs of neighboring sites on the pixel lattice. 

In this simulation, we adopt Tg = l//3s = 2.15, gen- 
erate the image {^i} by the prior probability (p7|), and 
corrupt by flipping each pixel by the probability p = 0.1. 
We use only the raw code channel, not the parity check 
code channel in this simulation. By using the mean field 
theory, Nishimori & Wong proved that the overlap Mo is 
maximized despite of the dimensions of the system (im- 
age size), when the decoding temperature Tm equals the 
image generating temperature T^. In the simulation, we 
set Tg = Tm = 2.15. Figure |lO| shows the reproducing 
result of the Ising/analog model with nearest neighbor 
interaction obtained by the computer simulation. With 
the nearest-neighbor interaction model, it is clear that 
the overlap of the analog model is smaller than that of 



the Ising model. We believe that this phenomenon oc- 
curred because the analog model does not gather in the 
effect of fluctuation by other pixel values. 

Thus, we should consider the nearest neighbor inter- 
action prior effect in the computer simulation. Figure 
pi] shows an example of the computer simulation result. 
Each image has an area of 400 x 400 pixels. Figure [Tl](a) 
shows the original image. In this image, noise-like pat- 
terns are inherently contained. Figure ^l](b) shows the 
corrupted image. Figure pT|(c) shows the restoration re- 
sult by the Ising model, and Figure |ll|(d) shows the result 
by the analog model. The overlap of the Ising model (Fig- 
ure [ri|(c)) becomes Mo = 0.879, and the analog model 
(Figure |ll|(c)) becomes Mo = 0.837. In addition, when 
we applied the image restoration by MAP inference, the 
noise-like patterns contained in the original image (Fig- 
ure |ll|(a)) were eliminated by the prior probability term. 
Thus, to maintain the fine structure of the original im- 
age, the MPM inference is an effective method. This 
characteristics was confirmed in the analog model by the 
computer simulation. 



IV. DISCUSSION 

In this research, we discussed the image restoration 
problem by finite temperature decoding. In the MPM in- 
ference proposed by Nishimori & Wong, many trials are 
required to calculate the thermal average for each unit. 
We tried to replace this operation with deterministic dy- 
namics called naive mean field approximation. At first, 
we applied mean field approximation to the infinite range 
prior model and analyzed this approximated system by 
the replica method. We also quantitatively compared the 
restoration ability of the Ising stochastic model with that 
of the analog deterministic model. As a result, we proved 
that their abilities are equivalent when we used only the 
raw code signal, that is, equivalent to conventional image 
restoration. Assuming a redundant signal, called the par- 
ity check code, the result of each method differed slightly. 
However, when we adopted the ratio of the coefficients 
properly, that is, the coefficients /3, h, and (3m, the restor- 
ing ability of each method showed no difference. This 
means that if we can estimate these coefficients, called 
hyper-parameters, we can apply the analog deterministic 
method without worrying about the restoration ability. 
Moreover, the analog deterministic method is 50 times 
faster than the Ising stochastic method. 

In the future problem. In analog model, Horiguchi 
pointed out that the inclination of output function 
around ±1 cause constitutive difference |1^. Thus, we 
should consider this effect. 

Moreover, we will attempt to propose a more effective 
analog approximation method for the nearest neighbor 
interaction model. 
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(a)Original (b)Noised (c) Ising (d)Analog 

M=0.879 M=0.837 

FIG. 11: Example of image restoration. The original image was created with a Ising/analog model with nearest neighbor prior 
model, (a) Original image; (b) Noised image; (c) Ising restoration result by MPM estimation; and (d) Analog restoration result 
by MPM estimation 
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